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The classic hypergeometric distribution describes sampling without replace- 
ment from a single urn. Here, I consider a related problem of drawing indepen- 
dently, and without replacement, from two separate urns in which the same n dis- 
tinct categories of balls exist, but with varying numbers of balls belonging to each 
category in each urn. The statistic of interest is the size of the intersection of ball 
categories when we sample independently from each urn. I show that when both 
urns contain a single ball in each of the categories, the distribution of intersection 
sizes is hypergeometric. Extending this to the case in which the second urn con- 
tains duplicates in g < n of its categories, I derive a variant of the hypergeometric 
distribution and show that it is exact using simulations. I also derive the distri- 
bution of absolute pair-wise distances between intersection sizes when sampling 
separately from two sets of urns and discuss some of the properties and uses of 
this distribution. 

Introduction 

The hypergeometric distribution 1 1 1 describes the probability of k successes in n draws 
without replacement from a single population of size N in which reside K possible 
successes, and is given by 



If, for example, we have 10 red balls in a total population of 20 balls, the above formula 
gives us the probability of drawing A; < 10 red balls given that we sample n < 20 balls 
in total. The distribution has been broadly applied to tests of significance for categorical 
data in which objects can be classified in two different ways |2-4|. 

Here, I consider another sampling-without-replacement problem. Imagine instead 
that we have two separate urns each containing balls that belong to one of n distinct 
categories of balls. If we draw a balls from the first urn and b balls from the second, 
what is the probability of finding an intersection of size v in the categories of balls 
drawn from both urns? Thus, in contrast to the hypergeometric distribution, this prob- 
lem involves more than 2 categories of objects and independent sampling from two 
separate urns (Figure [TJ. 
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Figure 1 . A schematic illustrating the drawing of intersections from urns containing balls 
belonging to 5 different categories (depicted using different colours). In urns A and Bi 
there is exactly 1 ball in each of the categories, whereas in urn B2 3 of the categories 
contain duplicate members. Although both duplicates of one category are drawn from 
this urn, the intersection size remains 1 . 



A real-world example of this type of problem arises in molecular biology. If we 
know that a set of genes in species 1 shares a particular characteristic (e.g. expression 
in the same organ) in common with a second set of genes in species 2, then we might 
ask whether there is a significant enrichment of homologous genes in the intersection 
of both gene sets (where categories are defined by homology). 



Results 

Symmetrical, singleton case 

First, I consider the simplest scenario in which each urn contains exactly one member 
in each of the n categories, i.e. a symmetrical, singleton case (corresponding to sam- 
pling from urns A and Bi in Figure [TJ. We sample a < n and b < n from each urn 
respectively and wish to know the probability of drawing intersections of size v where 

max(a + b — n,0) < v < min(a, b). 

To count the number of ways of picking an intersection of size v, it is useful to 
note that for the first urn there are ("Z") ways to draw one particular combination of 
intersecting categories (e.g. categories 1,2,3 for v = 3). However, once we have drawn 
from the first urn, this leaves (^Z") ways of drawing from the second urn to give an 
intersection size of v for a single, specific combination of categories - the upper index 
of {n — a) ensures that we do not count intersections of size larger than v. The total 
number of ways to pick intersections of size v must then be summed over all (") 
category combinations: 
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Figure 2. Match between theory and simulation for 3 parameter sets in the sym- 
metrical, singleton case (A and Bi in Figure [T|. Simulations (Sim) consisted of ran- 
domly and independently sampling twice (without replacement) from n distinct cate- 
gories and recording the size of the intersection each time (repeated 500,000 times for 
each distribution). From left to right, the parameters were: n = 100, a = 20,6 = 30; 
n = 100, a = 70, & = 60; n = 155, a = 110, h = 115. 
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The probability of picking an intersection of size v is then Cy divided by the total 
number of ways of picking a and b from n: 

^n\ fn—v\ /n — a\ 
-Tj/x^ \ \vJ \a~vJ \b—v J z^-. 

Applying a trinomial revision ||5J to the first two binoniials in the numerator, the ex- 
pression can be reduced to 

/n\ /a\ /n — a\ / a\ /n~a\ 
Tj/ \r \ \a/ \v/ \b—v/ \vJ \b—vJ /on 

which is the hypergeometric distribution given in Equation [T] and is symmetrical in 
terms a and b. The symmetry of the problem, in which both urns contain exactly 1 
member in each of the n categories, enables this simplification. Simulations show that 
the distribution is exact (Figure [2|. 
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Asymmetrical, duplicates case 

If we allow duplicates in q < n of the categories in the second urn (each category can 
contain 1 or 2 balls but not 0), then the problem becomes asymmetrical (corresponding 
to A and B2 in Figure[T]l. The presence of duplicates in the second urn will reduce the 
overall chance of drawing an intersection of a certain size because duplicates that are 
both sampled from the urn can at most contribute an intersection of size 1 (see Figure 
[T}. Thus, it is reasonable to conjecture that the expectation for this distribution will 
always be less than for the equivalent symmetrical, singleton case: 

E{X\q^O)<-. (4) 
n 

Furthermore, we can reasonably suppose that the expression describing this distribution 
will be a variant of the hypergeometric since we have made only a small modification 
to the basic problem, and added a single parameter, q. I begin, therefore, by modifying 
Equation|2]to account for the effects of including q duplicates. 

There are three main differences affecting the drawing of both intersecting and non- 
intersecting categories: 

1 . When a category is sampled from the first urn (among the a — v non-intersecting 
categories) for which there is a duplicate pair in the equivalent category in the 
second urn, this reduces the number of ways we can pick non-intersecting cat- 
egories from the second urn to ensure an intersection size of v. The number of 
such draws is indicated by the subscript to. 

2. If a category with a duplicate pair is picked in the v intersecting items, this does 
not reduce the number of ways of picking non-intersecting items from the second 
urn (since drawing the duplicate member will also produce an intersection of size 
v), but it removes a duplicate category from the to that could be picked in the 
non-intersecting set. The number of such draws is indicated by subscript I. 

3. Picking I duplicate categories in the v intersecting items increases the number of 
ways that these items can be drawn, but for each duplicate that is picked in v, 
one less duplicate is available for the non-intersecting set to be drawn from the 
second urn. The number of such draws is indicated by the subscript j. 

To calculate the probability, we must sum over all of the ways of combining the above 
events such that they produce intersection sizes of v, which must satisfy 

max{a + 6 — n — q, 0) < u < min{a, b). 

I will move from left to right across the numerators of Equation |2] and describe how 
each binomial term must be modified. The number of ways of drawing v intersecting 
categories, (") , must incorporate consideration for the / duplicate categories listed in 
point 2 above, leading to: 

??(::OC)G)' 

which counts the total number of ways of picking v with and without / duplicates. 
The number of ways of picking non-intersecting categories from the first urn for a 
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single category combination, ("_^), must be modified to account for the m duplicate 
categories listed in point 1 above: 



EE 



q + l\ fq ~ I 
ni 



which counts the number of ways of picking a ~ v non-intersecting categories given 
that we have sampled both m and I duplicates. Finally, the number of ways of picking 
non-intersecting items from the second urn, ('^'Z") ' must be modified to account for a 
reduction in duplicates that can be drawn to ensure an intersection size of v: 



EE 



q — a — m 
b — v 



which counts the number of ways of picking b — v non-intersecting categories from the 
second urn given that we have picked m non-intersecting duplicate equivalents and j 
intersecting duplicate equivalents from the first urn. 

Summing over all the possible combinations of these events then gives us the total 
number of ways of picking an intersection of size v in the duplicate case (underbraces 
indicate equivalent expressions in the symmetrical singleton case in Equation[2]i: 



n — q\ f q\ f L \ fq — L\fn — v — q + l\ fn + q — a — m — j 



^.^ = EEE 

m=0 1=0 j=0^ 



V — I J \l J \jj \ mj\a — V — mj\ b — v 



C) {:--:) (r:) 

where 

/3 — min(a — v, q) and 7 = min(u, q — ni). 

The probability is then C^f divided by the total number of ways of picking a and b from 
both urns: 



b r 



V^' (n — q\rq\rl\rq—l\/n—v — q+l\/n+q—a—m—j\ 
_ m=0 2^1=0 l^j=0\v-ll\l)\ii \ m )\ a-v-m )\ b-v ) 

i -V)- (5) 

A closed-form expression for the above equation is not forthcoming, however, it is 
clear that the following identity is true: 

v=0 ^ ^ 

where a — min(a, 6). Once again, simulations show that the distribution is exact 
(Figure |3]l. 

The distribution of intersection distances 

When drawing intersections from two different distributions (with different parameters, 
or, for example, with a singleton case and a duplicate case) it might be of interest to 
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Figure 3. IVIatcli between theory and simulation for 3 parameter sets in the asymmetri- 
cal, duplicate case (A and B2 in Figure[T|. Simulations (Sim) consisted of randomly and 
independently sampling twice (without replacement) from n distinct categories (in which 
the second set contained q duplicates) and recording the size of the intersection each 
time (repeated 500,000 times for each distribution). From left to right, the parameters 
were: n = 100, a = 35,fe = 42, g = 59;n = 100, a = 63, fe = 79, q = 73; n = 130, a = 
110,6= 115,q = 47. 



ask whether the absolute distance between their intersection sizes is what would be ex- 
pected by chance. To calculate the probability of finding an intersection distance of size 
d, we need to sum over all the ways to produce d when pairing our two distributions: 

P{X = d)^ J2 P(wi.|ni,ai,6i,...) •P(«2jri2,a2,&2,...) (6) 

{vi,V2}i&Dd 

where Dd is the set of pairs of intersection sizes, {wi, ^2}, with absolute differences of 
size d. If R and S are the sets of all possible intersection sizes for both distributions, 
then 




min(|i?|, |5| - rf) + minds'!, |i?| - d), ifd> 



where min(|i?|, \S\ — d), mindS*!, \R\ — d) > (i.e. negative values are set to zero). 
This distribution has a relationship to the intersection distributions that is similar to the 
relationship between the binomial and Bernoulli distributions. 

Testing for significant differences between intersection sizes is likely to be of in- 
terest when we want to know if they are behaving differently, i.e. are the intersection 
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Figure 4. Two intersection distributions (in black and red) and tlieir distance distribution 
(in dark green and red). One-tailed tests for greater intersection sizes than expected by 
chance have been applied to both intersection distributions at 19 (left) and 87 (right). 
This gives a distance of 68, which is greater than expected by chance (P = 0.0014) 
even though significance at the 5% level was marginal for only one of the intersection 
distributions. Parameter values for the two intersection distributions were, from left to 
right: n = 60, a = 40, 6 = 35; n = 155, a = 110, 6 = 115. 



sizes that we observe falling into opposite tails more than would be expected by chance 
(Figure |4]i? 

Related distributions: drawing from a single urn 

It is useful to consider the related, though simpler, distribution associated with drawing 
a balls from n categories with q < n duplicates from a single urn. In this case, we are 
no longer interested in intersection sizes, but rather in the number of distinct categories, 
c, which are drawn from the single urn. When q — then c — a necessarily. Thus, we 
restrict ourselves to cases where < q < n. The bounds on c are then 

a — min ^ — ,q^<c<a 

where the lower bound is determined by the maximum possible number of duplicate 
pairs subtracted from a. For any particular value of c, there are always a — c duplicate 
pairs that must be picked to ensure that there are c distinct categories drawn. 
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To count the number of ways of drawing c categories, it is useful to first note that 
there are 3 combinations that need to be counted: 

1. The number of ways of picking a — c dupUcate pairs, i.e. {1,1}, {2,2}. 

2. The number of ways of picking duplicates not picked as pairs from the q — a + c 

remaining. 

3. The number of ways of picking non-duplicates. 

Point 1 is simply given by For points 2 and 3, we must sum over all the ways 

of combining duplicates (not picked as pairs) and non-duplicates to give c distinct 
categories. An important quantity here is the number of non-duplicate pairs (not {1,1} 
or {2,2}) in a, given by a — 2(a — c) = 2c — o. Then 

f q — a + c\ fn — a + c — j 

3=0 

gives the combined number for points 2 and 3. The probability of picking c distinct 
categories is then given by 

( 1 \ /q-a+c\ /n-a+c-j\ 

P{X = c) = ^ J ' ^ ^ ■ (7) 

V a / 

Again, a closed-form expression is not easily derived. However, if we focus on the 
special case when q = n, the above expression can be simplified. Substituting q = n 
and applying a trinomial revision to the binomials within the sum, the numerator can 
be reduced to 

n \ /n — a + c\ ^ /2c — a 
a-c)[ 2c-a J j 



j J \ 2c-a-j 



which in turn simplifies to 



3=0 



■y2c—a 



From left to right, the three terms count the number of ways of picking c distinct cat- 
egories from n, the number of ways of picking a — c duplicate pairs from c, and the 
number of ways of picking 2c — a duplicates not picked as dupUcate pairs. The proba- 
bility of drawing c distinct categories when all categories in the urn contain a duplicate 
is then given by 



m = c)='-^^^, . (8) 



Deriving the expectation of this distribution requires simplifying 

where /3 = o — [|J . Again, a closed-form is not apparent. Future work on this 
distribution and its properties will no doubt help to shed light on the related intersection 
distributions. 
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Summary 



I have discussed a sampling-without-replacement problem that is closely related to the 
hypergeometric distribution. The main differences are: 

1. Samples are taken independently from two separate urns. 

2. More than 2 categories of objects are allowed. 

3. The statistic of interest is the size of the intersection of the two samples. 

When there is exactly one ball in each of the categories in both urns, I have shown 
that the distribution is hypergeometric. However, with one small modification to the 
basic problem - the addition of q duplicate categories in the second urn - the problem 
becomes much more complex, and the distribution no longer can be expressed in a 
closed form, though it is clear that this asymmetrical case is a variant of the hyper- 
geometric. Furthermore, I derive the distribution of absolute distances between the 
intersection sizes of two separate intersection distributions. This distribution has utility 
when the question of interest is whether two intersection sizes are behaving signifi- 
cantly differently. Finally, I derived a closed-form expression for the distribution of 
distinct categories sampled from a single urn containing duplicates in all of its cate- 
gories. This related distribution may aid in the understanding of intersection distribu- 
tions and their properties, and ultimately is an attempt to work towards a more general 
description of this broad class of distributions. 
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